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Risk Index: A Sample Result 


Call Grph 

PEGTask 

Overall 

Total Test 

Functional 

Risk Index S/W 

Number 

Components 

Susceptibility 

(1 = bad) 

Coverage % 

Criticality 

(Inmost crit) 

Reliability 

(0 to 1. 1=high) 

7 

Current_Acc 

4 

72% 

1 

0.07 

8 

CALC_VRATIO 

4 

73% 

1 

00675 

9 

Time_To_Go 

4 

89% 

1 

0.0275 

10 

Thrustjntegral 

3.5 

100% 

1 

0 

11 

Reference_Thrust_Vectors 

4 

100% 

1 

0 

12 

Util_Midval 

4 

70% 

1 

0075 

13 

UTIl_V__Magnitude 

3 5 

0% 

1 

0 375 

14 

Gmd_Pred_Eq_Zero 

4 

90% 

1 

0025 

15 

UTIL_MT 

4 

0% 

1 

0 25 

16 

UTIL_M1_Times_M2 

3 5 

0% 

1 

0 375 

17 

UTIL_M_Times_V 

3 5 

0% 

1 

0 375 

18 

UTIL_MT_Times_V 

3 

0% 

1 

0.5 

19 

UmtVector 

4 

93% 

1 

0.0175 

20 

H_Ellipsotd 

4 

96% 

1 

0.01 

21 

Alt_Ge_400k 

4 

0% 

1 

025 

22 

AlfLt_400K 

4 

"0% 

1 

0.25 

23 

AltJtJSOOk 

3 

0% 

1 

0.5,' 

24 

Alt_Ge_600k 

4 

0% 

1 

0.25 

25 

Accel_Drag 

3 

0% 

1 

05 

26 

Drag_Accel 

3 

0% 

1 

05 

27 

Drag_Accel_Bypass 

4 

0% 

1 

0.25 

28 

delta^acceljmu 

1 

0% 

1 

1 

29 

no_delta_accel 

4 

0% 

1 

0.25 

30 

Gmd_Pred_Not_Zero 

3 

0% 

1 

05 

31 

Nsteps_Stepsz 

3 

86% 

1 

0.07 

32 

Nstep_Do_Loop 

1 

23% 

1 

0.77 

33 

Enlry^Precise^PrediCtor 

3 

19% 

1 

0.405 

34 

Burnout_Slate_Vector_Pred 

3 

42% 

1 

0 29 

35 

V_Magnitude 

3.5 

100% 

1 

0 

36 

Send_Unit_Vector 

4 

100% 

1 

0 

37 

Send_Zero_Vector 

4 

100% 

1 

0 

38 

UTIL_V Unitize 

3 

68% 

1 

0 16 
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Example Result of Complexity Study (1) 


WIND TRJD SORT SECA 5AVS SAVA QAQB POKE NEWT MAIL BRBA 



MMDE 


ADCO 


Application: newcode Language: FORTRAN 

Version: VERSIONl 

Call graph of root: 


// 


Example Result of Complexity Study (2) 


subsys 


Deorb L t 


Deorbit 


PEG Task 


< LTVC 


_PE>j 


Continue 


Finish P 


VEL TO B 


Burnout 


Re fe renc 


Thrust I 


Time To 



ftpplication : SOURCE Language: C 

Version : CURRENT_VERSION 

Calling/called components graph of the root : 


LTVC PEG 


Example Result of Complexity Study (3) 



EVTPRT 



Example - A “Green” module 
(Least Error Proneness) 

Susceptibility Level = 1.1 



High Metric Metric C 
tolds Value Eval. 

& 400 21 Green 

i 100 6 Green 

& 15 2 Green 

& 8 1 Green 

& 10 2 Green 

& 15 2 Green 

Green 
Green 
Green 
Green 
Green 
Yellow 
Green 
Green 
Green 
Yellow 




Green 


Green 


Green 

Green 


& 2,000 



ines of Code 


MAINTAINABILITY 


Normalized 
Cyclomatic 1 Program 


Pathological Complexity I Length 
Complexity * 


Essential 

Complexity, 


Cyclomatic 

Complexity/ 


%of 

Comments L =*? 


Lines of 
Code 




COMPLEXITY 


Cyclomatic 

Complexity 


Essential 

Complexity 


Module Design 
Complexity 


Program 

Volume 


Cyclomatic 

Complexity 


Program j 
Length / Module 
Design 
Complexity 


l/F COMPLEXITY 


Pathological 

Complexity 


TESTABILITY 



Example - A “Yellow” module 
(Medium Error Proneness) 



Normalized 


Cyclomatic 

Complex*? 


Complexity 


Program 

Volume 


Program / 
Length/, 


I Pathologica 
Module \ Complexity 
Design \ 

Complexity \ 


l/F COMPLEXITY 


Susceptibility Level = 2.2 


Low & High 

Metric 

Metric Category 

Category Metric Thresholds 

Value 

Eval. Eval. 

Complexity Prog. Length 300 & 400 

820 

Red Red ! 

Lines of Code 60 & 100 

101 

Red 

Cyclom. Complex. 10 & 15 

41 

Red 

Essent. Complex. 4 & 8 

1 

Green 

Testability Design Complex. 7 & 10 

8 

Yellow Yellow 

Cyclom. Complex. 10 & 15 

41 

Red 

i Pathol. Complex. 1 & 2 

1 

Green 

l/F Complex. Design Complex. 7 & 10 

8 

Yellow Yellow 

Maintainab. Prog. Length 300 & 400 

820 

Red Yellow 1 

Prog. Volume 1,500 & 2,000 5,730 

Red i 

Lines of Code 60 & 100 

101 

Red 

i 1 - % of Comments 0.2 & 0.8 .65 

Yellow 

Cyclom. Complex. 10 & 15 

41 

Red 

Essent. Complex. 4 & 8 

1 

Green 

J Pathol. Complex. 1 & 2 

1 

Green 

Normal. Cyclom. .28 & .60 
Complexity 

.41 

Green 


Cyclomatic 1 / 

Pathological Complexity // Program 
Complexity^- — ^ 

Essential • /\ ! ^1 

Complexity/^ \ ^ 

Cyclomatit>vy \ \ /• I • / 


OMPLEXITY 


%of 


Essential 

Complexity 


Module Design 


/ Complexity 
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Example - A “Red” module 
(Most Error Proneness) 



Susceptibility Level = 2.5 


Normalized 

Cyclomatic 

Complexity] 


Program 

Length 


Pathological 

Complexity 


Essential 

Complexity 


Lines of Code 


Cyclomatic 

Complexity 


%of 

Comments 


Prograrr 

Volume 


Program 
Length / 


Pathological 

^Complexity 


Module 

Design 

Complexity 


l/F COMPLEXITY 



Low & High 

Metric 

Metric Category 

Category 

Metric Thresholds 

Value 

Eval. 

Eval. 

Complexity 

Prog. Length 300 L 400 

633 

Red 

Red 


Lines of Code 6(V& 100 

137 

Red 



Cyclom. Complex. §Q&15 

41 

Red 



Essent. Complex. 4 

30 

Red 


Testability 

Design Complex. 7 & 10 
Cyclom. Complex. 10 & 15 

41* 

Yellow 

Yellow 


Pathol. Complex. 1 & 2 

1 

GreerT^ 


l/F Complex. Design Complex. 7 & 10 

8 

Yellow 

YeTtaAC, 

Maintainab. 

Prog. Length 300 & 400 

633 

Red 

Yellow 


Prog. Volume 1 ,500 & 2,000 4,431 

Red 

/ 

Red 

Lines of Code 60 & 100 

137 

Red 



1 - % of Comments 0.2 & 0.8 

.40 

Yellow 



Cyclom. Complex. 10 & 15 

41 

Red 



Essent. Complex. 4 & 8 

30 

Red 



Pathol. Complex. 1 & 2 

1 

Green 



Normal. Cyclom. .28 & .60 

.30 

Yellow 



Complexity 


Cyclomatic 

Complexity 


Essential 

Complexity 


y ^ 

/ Module Design 
Complexity 



Example - Analyze Test Coverage of Code 
and Test Efficiency (1) 


• cmp2.c , the most relevant function with date sorting, only has a 67% 
block coverage 

File Tool Options Summary TestCases Update GoBack Help 

v by- type ♦ by- file by- function Disable Sort_by 


block coverage summary by file over selected testcases 


cmp 1 . c 

101 of 102 

99% 

♦ cmp2 . c 

75 of 112 

67% 

ma in . c 

166 of 178 


mi sc . c 

93 of 101 

92 . 1% 

qsort . c 

31 of 33 

93.9% 

sk ip . c 

28 of 29 

96. 6% | 

sort . c 

38 of 59 

64.4% 


93 . 3% 


total 


532 of 614 
Coverage : 


Files : 


8 6 . 6 % 


Test cases: 


XATAC 


block 


7 of 7 


62 of 62 



Example - Analyze Test Coverage of Code 
and Test Efficiency (2) 


File Tool Options 


Summary TestCases Update GoBack Help 




do ++p; while ( isalpha ( *p) ) ; 
break; 
case' o' : 


month = 11; 

do ++p; while ( isalpha ( *p) ) ; 
break; 
default : 

Ntum ass 

} 


value = 0; nDicjits = 0; 
while ( isdigit ( *p) ) { 

++nDigits; 

value = value * 10 + *p++ - 'C 

} 

if (del im == ' -' ) | 

if (value < 1 | | value >31 | | 
retu rn - 1; 

day = value; M 

} else { 

if (nDigits == 2) 

year = 1900 + value; 
else if (nDigits == 4) 
year = value; 
else return -1; 

} 

return year * 10000 + month * 100 


nDigits > 2) 

Covering this red block 
guarantees the execution of 
at least 8 additional blocks. 


day; 


%ATAC 


File : 
cmp2 . c 


L ine : 

Coverage : 

Highl ight ing: 

121 of 151 

block 

all prioritized 


n 


Cumulative # of Failures 


Software Reliability: Basic Concepts 
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Software Reliability: Example (1) 


Musa’s Basic Execution Time Model 
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Software Reliability: Example (2) 
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Software Reliability: Example (3) 
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Software Reliability: Example (4) 
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Life Cycle Application of the Risk Model 
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Software Capability Maturity Level 


Level 

Characteristics 

I. Initial 

Ad hoc, few processes are defined 

II. Repeatable 

Basic project management processes are 
established to track cost, schedule, and 
functionality 

III. Defined 

Process for both management & engineering 
activities is institutionalized 

IV. Managed 

Process and product quality are quantitatively 
understood and controlled 

V. Optimizing 

Improvement is enabled by quantitative 
feedback from the piloting of innovative ideas 
and technologies 
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